Automatic Acquisition of Word Meaning from Context

AUTOMATIC ACQUISITION OF WORD MEANING FROM CONTEXT by Peter Mark Hastings Chair: Assistant Professor Steven Lytinen This thesis presents an automatic, incremental lexical acquisition mechanism that uses the context of example sentences to guide inference of the meanings of unknown words. The goal of this line of research is to allow a Natural Language Processing (NLP) system to cope with words that it does not know | not just to gloss over them, but to try to infer what they mean. The environment within which this system operates is epitomized by the information extraction task: from virtually unconstrained text, elicit certain information that is deemed interesting. The knowledge acquisition bottleneck inherent in this task imposes constraints on the type of knowledge available for lexical inference. The main objective in this work is to infer as much information as possible about unknown words from context without requiring special-purpose knowledge. This was accomplished by extending the underlying NLP system to search its domain-speci c concept representation for an appropriate concept to denote the meaning of the unknown word. The learning method is incremental, so every time the system encounters an example of an unfamiliar word, it adjusts its hypotheses. The basic system evolved through several di erent stages in order to improve its inferences. Then several variations to the basic system were made to capture especially di cult aspects of the acquisition task and to take advantage of discourse context. The approach was tested in two di erent domains. Target words were removed from the lexica and sentences containing them were processed by the system. The results were evaluated using measures taken from the eld of Information Retrieval. When humans learn language, they are faced with a similar task: from a set of examples of a word's use, they must infer what that word means and how it is used. Not only is the task similar, but many of the behaviors and di culties that the computational acquisition mechanism have encountered have also been described in the psycholinguistic literature. Although the system was not intended as a cognitive model, these parallels indicate strong constraints from the task itself, and therefore lend credence to viewing the system as a cognitive model. AUTOMATIC ACQUISITION OF WORD MEANING FROM CONTEXT